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(57) Abstract 

A system and method for imaging reflective surfaces are disclosed wherein a diffused light source having a predetermined frequency 
range and in a predetermined pattern is directed toward the reflective surface. The light reflecting off the surface passes through a filter 
for filtering out ambient light and reaches a detector. The detector detects the light. Using triangulation with two points within the pattern, 
a microprocessor determines a distance to an image formed behind the reflective surface. The microprocessor also calculates a distance 
to the reflective surface in dependence upon the distance to the image and the locations of the diffused light source and of the detector. 
Alternatively, two detectors are used, requiring a point source of diffused light. 
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System and Method for Capturing a Range Image of a Reflective Surface 

Field of the Invention 

The invention relates to three dimensional (3-D) computer vision and more 
particularly to three dimensional imaging of objects having reflective surfaces. 

5 Background of the Invention 

Human vision relies on experience and stereoscopic vision to determine ranges of 
objects. Each of two eyes capture an image from locations offset by a predetermined 
distance, and the brain determines a range to at least an object within a field of view. 
When peering into a mirror, a person sees images within the mirror of objects that are 
1 0 outside the mirror. Stereoscopic vision establishes a distance to the images that is 

substantially the distance light travels from the objects to the person's eyes. As such, the 
English language has an expression "tricks with mirrors" wherein mirrors are used to alter 
a physical space. For example, placing mirrored tile on a wall in a small room, makes the 
room appear much larger. 

1 5 Stereoscopic systems similar to human vision have been proposed for computer 

vision with applications in measurement, testing, robotics, modeling, manufacturing, 
navigation, and so forth. It is the very breadth of applications for computer vision that has 
made them popular both in terms of research and adoption. 

Two popular techniques currently in use for optical ranging of a target surface are 
20 known, respectively, as the standard optical triangulation system and the Biris (bi-iris) 

system, the latter employing an apertured mask in a converging lens system of an imaging 
device having a position sensitive detector, e.g. a CCD camera. 

These systems are described and compared in a paper entitled "Practical 
Considerations for a Design of Industrial Systems, SPIE Vol. 959, 1988, pp 225-246 by 
25 F. Blais et. al., and also in. "Optical Range Image Acquisition for the Navigation of a 
Mobil Robot, " published in the proceedings of the 1991 IEEE International Conference 
on Robotics and Automation, Sacramento, California, April 9-11, 1991 by F. Blais et. al. 
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A further article of note is "Active, Optical Range Image Sensors." by Paul J. Besl, 
Machine Vision and Applications ( 1 988) 1 : 1 27- 1 52. All these documents are hereby 
incorporated herein by reference. 

A sample machine vision system is disclosed in U.S. Patent number 5, 270, 795 
5 entitled Validation of Optical Ranging of a Target Surface in a Cluttered Environment, in 
the name of F. Blais. The system comprises a collimated laser light source and an image 
capture means for capturing light diffused by opaque surfaces. It merges the features of 
standard optical triangulation systems and those of Biris systems. The system uses a laser 
light source and a detector having two irises distanced apart. Light from the laser diffused 
1 0 from opaque surfaces is detected at the detector through each of the two irises. The 
resulting images are correlated to determine range. Unfortunately, when surfaces are 
reflective or transparent, collimated light sources are often reflected as collimated beams 
missing the image capture means. As such, many range sensing means relying on optical 
range sensing are limited to substantially opaque surfaces. The content of U.S. Patent 
1 5 number 5, 270, 795 to F. Blais is hereby incorporated herein by reference. 

In U.S. Patent 4,645,347 titled Two Dimensional Imaging Device in the name of Rioux, 
a mask aperture having a plurality of apertures therein is described for use in imaging. 
Such a mask is cost effective in reducing a number of required detectors in an imaging 
system and for reducing effects caused by vibration. 

20 Object of the Invention 

In an attempt to overcome these and other limitations of the prior art, it is an 
object of the present invention to provide a system and a method for ranging reflective 
surfaces and for determining a geometry for said surfaces. 

Summary of the Invention 

25 In accordance with the invention there is provided a method of measuring a distance from 
a first location to a reflective surface. The method comprises the steps of: 
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directing diffused light toward the reflective surface forming an image therein; 

using a range imaging means having a detector, measuring a distance from the detector to 
the image; and 

determining the distance to the reflective surface based on a known relationship between 
5 the location of a diffused light source, the location of the detector and the distance from 
the detector to the image. 

In accordance with the invention there is provided a method of measuring a distance to a 
reflective surface comprising the steps of: 

projecting toward the reflective surface a pattern of diffused light forming an object; 

10 using an imaging means comprising a detector, said detector having a known spatial 

relation to the object, receiving some of the projected light reflected off of the reflective 
surface and forming an image of the object; 

using a processing means, determining a range to an image of the object; and 

using the processing means, determining a distance to the reflective surface based on the 
1 5 known spatial relation and the image range. 

In accordance with another aspect of the invention there is provided an imaging system 
comprising 

a diffused light source for directing diffused light toward a surface and for forming at 
least an image therein; 

20 an imaging means comprising at least a detector for receiving diffused light reflected from 
the surface and having a predetermined spatial relation with the diffused light source; and 

image processing means for determining a distance from the system to an image 
of the at least an image and for determining a distance from the system to at least a 
location on the surface from which diffused light is reflected. 
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An advantage of the present invention is the ability to model reflective surfaces 
using an optical range measurement device. 

Brief Description of the Drawings 

Exemplary embodiments of the invention will now be described in conjunction 
5 with the following drawings, in which: 

Fig. 1 is a simplified diagram of a prior art imaging device imaging a reflective surface; 
Fig. 2 is a simplified diagram of a prior art imaging device failing to image a reflective 
surface; 

Fig. 3 is a simplified diagram of a device according to the present invention imaging a 

1 0 reflective surface; 

Fig. 4 is a simplified diagram of a device according to the present invention imaging a 

planar reflective surface and indicating the effect of a field of vision upon a detector; 

Fig. 5 is a simplified diagram of a device according to the present invention incorporating 

two detectors and a single diffused light source; 
15 Fig. 6 is a simplified diagram of a device according to the present invention incorporating 

two detectors and two diffused light sources; 

Fig. 7 is a simplified diagram of a device according to the present invention incorporating 
three detectors and a diffused light source; 

Fig. 8 is a simplified diagram of a device according to the present invention incorporating 
20 two detectors and two diffused light sources; 

Fig. 9 is a simplified diagram of a device according to the present invention incorporating 
a plurality of detectors and a single diffused light source and imaging a transparent 
substrate having a predetermined non-zero thickness; 

Fig. 10 is a simplified diagram of a device according to the present invention imaging a 
25 reflective surface that is non-planar; 

Fig. 1 1 is a diagram showing a triangulation method of determining image range; 

Fig. 12 is a simplified diagram of a Biris range system employing a single Biris detector 

and four diffused light sources; and 
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Fig. 13 is a flow diagram of a method of determining distance and reflective surface 
geometry according to the present invention. 

Detailed Description of the Invention 

Reflective surfaces reflect incident light at an angle equal to the angle of incidence. In 
Fig. 1 is shown a reflective surface 5 with an object in the form of a collimated laser light 
source 2 having an iris with a predetermined shape 3, and a detector 9, on a first side 
thereof and according to the prior art. On a second side thereof is an image 7 of the object. 
Once a range for a reflective surface 5 has been determined, a detector 9 and a collimated 
laser light source can be aligned (as shown in Fig. 1) to allow for the detector to capture a 
reflected collimated beam 4c. Unfortunately, absent knowledge of range, orientation, and 
characteristics such as shape, alignment is not possible and detecting the collimated 
reflected beam is a matter of chance. 

Referring to Fig. 2, a reflective surface 5 in the form of a polished mirror is shown 
having an object, a collimated laser light source 2 having an iris with a predetermined 
shape 3, and detector 9 according to the prior art on a first side thereof and having an 
image on a second side thereof. Paths of light are shown for light from the collimated 
laser light source 2. As can be seen, light reflected by the reflective surface 5 misses the 
detector 9 and therefore is not used in determining a range for the surface 5. Alternatively, 
when light is diffused at the object, it is imaged by the detector 9 and is used for 
determining a range. Resulting range images treat reflective surfaces and transparent 
surfaces as holes or worse yet, inconsistently treat them as either holes or, when 
alignment happens to be appropriate, as surfaces. Further, the number of diffused and 
reflected signals reaching a detector leads to inconsistent range detection. 

Referring to Fig. 3, an embodiment of the present invention is shown opposite a 
reflective surface 5 in the form of a highly polished mirror. A laser light source 2 is 
diffused by diffusion means 30 producing a recognizable pattern of light and dark (two 
diffusing circles and an opaque frame). Diffusion means 30 acts as diffusing irises and 
results in a plurality of objects. A detector 9 in the form of a CCD is positioned for 
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receiving light from the objects once the light is reflected off a reflective surface. The 
detector 9 is provided with a frequency selective filter means 56 for filtering frequences 
other than a predetermined range of frequencies. This allows use of the invention in 
lighted conditions. Alternatively, the filter means filters ambient light of predetermined 
5 frequencies. Further alternatively, no filter is used. Preferably, a diffused light source 
provides illumination of a large percentage of a field of view for the detector. Preferably, 
diffused light source thickness is small to result in sharp images at the detector 9. 

In operation, light emitted by the laser 2 is diffused by the diffusion means 30. 
The diffused light reflects off the reflective surface 5 and reaches the detector 9. It will be 
,0 clear to those skilled in the art that diffused light is likely to reach the detector 9 whereas 
collimated light would be less likely to reach the detector 9 in sufficient quantities. A 
range detection algorithm executed within a processing means 60. determines a distance 
between the detector 9 and images 7 of the objects (diffusion means) 30. The processmg 
means 60 then determines a range between the detector 9 and the reflective surface 5 m 
15 dependence upon the known relative locations of the objects 30 and the detector 9. 

Further, when sufficient images 7 are imaged by the detector 9 and in dependence upon a 
recognizable pattern of the objects 30, a surface shape of the reflective surface 9 is 
determined. 

In order to determine a range to an image at least two data points are required. 
20 These points can be acquired by projecting at least two light sources, by projecting an 
object with at least two discernible features, by capturing an image with at least two 
detectors or by capturing images with a detector provided with two irises (Biris). Each of 
these systems is discussed in detail below. 

Referring to Fig. 4, using a collimated light source and a diffuser, allows light 
25 within a narrow band of frequencies to be projected and to form several objects 31-36. 

Several objects result in several images 71-76 in reflection. Unfortunately, many detectors 
have small fields of view 10 of for example 30 degrees. 6 objects 31-36 form 6 images 
71-76 in a mirror 5 but only objects 33, 34, 35, and 36 are detected by the detector 9. The 
images are all visible to a human eye in a location chosen for a detector 9. Unfortunately, 
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due to a field of view 10 associated with the detector 9, the images 71 and 72 are not 
detected by the detector 9. Since a range is calculated to each image and there is a known 
distance between each object and the detector 9, a determination of which image is 
associated with each object is possible. This determination is then used to accurately 
5 determine a distance to the reflective surface 5. 

To distinguish between associated objects and images, some calculations are 
performed. A distance D ; is measured between the detector 9 and each image. Each 
distance corresponds to a series of potential locations and orientations of the reflective 
surface 5. The resulting equation for each distance Dj is a simple triangulation with an 
10 unknown angle at a vertex thereof. Thus, the distance D f is equal to the distance of 4a 
added to the distance of 4b. The distances of 4a and 4b are interrelated by the distance 
from the object to the detector K (shown in Fig. 10). A discussion of the calculations 
required and the definitions of K, Kl,.. is presented later. 

Associating an image for which a distance is to be calculated with an object 
1 5 determines a value for K. When the association is correct, a triangle is formed with a 
known base K and an unknown height. Relying on the rules of geometry, a unique 
triangle has been defined. In dependence upon the orientation of the base and an angle 
defined by a vertex of the triangle, surface orientation is determined. Therefore, by 
determining a distance to an image and using the known distance from the detector to an 
20 associated object, a distance to an imaged point on a surface is determined. The 
orientation of the surface can be determined using two measurements. 

Unfortunately, as shown in Fig. 4, some images are not detected. When this 
occurs, images and objects must be associated correctly in order to determine an accurate 
measurement of distance. A method of associating images and objects is to project objects 
25 that are distinguishable one from the other. Another method is to project objects spaced 
apart such that two objects associated incorrectly with images will result in the 
determination of different surfaces; correlating determined surface location and 
orientation allows for verification of results. 
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Applying this latter method to imaging a reflective surface is now described. An 
image is captured by the detector 9 (shown in Fig. 4) of a plurality of images. The number 
of images (4) is determined and a preliminary association is made. A distance to each 
image and a corresponding surface is determ.ned. Each surface is then compared to 
5 determine whether or not the determined surfaces are consistent. Associating the images 
with different objects is performed in order to determine a consistency of other 
associations. Once sufficient associations have been made, a most consistent surface is 
selected as the surface measured. When the surface or the detector is moving, the 
consistency of the surface is measured against other surface shape and distance 
10 determinations. 

When the reflective surface 5 has an irregular shape or is curved, further data 
points are required to resolve surface geometry. A method of doing so is shown in Fig. 10 
and described later. 

Using a single diffused light source in the form of an LED, a single object exists. 

1 5 By capturing an image with each of at least two detectors, A distance to the image can be 
ascertained. Referring to Fig. 5, an embodiment of the present invention is shown 
opposite a flat reflective surface. A laser light source 2 is diffused by diffusion means 30 
producing a recognizable pattern of light and dark. The diffusion means 30 acts as an 
object. A plurality of detectors 9a and 9b in the form of CCDs are positioned proximate 

20 the object. The detectors are provided with a frequency selective filter means 56 for 

filtering frequencies other than the laser frequency. Alternatively, the filter means filters 
ambient light at predetermined frequencies. Further alternatively, no filter is used. The 
use of two detectors results in the capture of two data points for the image (as is shown in 
Fig. 5) and allows for triangulation to be employed. 

25 Referring to Fig. 6, a system provided with 2 detectors and 2 diffused light 

sources is shown. The system results in the acquisition of 4 data points. Such a system is 
useful for range determination and for surface modeling of the reflective surface 5. For 
each image, a distance and surface orientation is calculated. Due to the increased number 
of data points, a solution is now possible (and unique) for surface distance, surface 
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orientation, and surface curvature (over a section of the surface). Moving the detectors or 
the surface allows image capture of the entire surface and allows for surface modeling. 
Preferably the relative motion is accurately measured to ensure accurate modeling. 

Referring to Fig. 7, an embodiment wherein a single diffused light source projects 
5 images to each of 3 image capture means is shown. In principal, the device operates 
similarly to that of Fig. 6. Triangulation is achieved between each pair of points (three 
different pairs) to determine information relating to surface distance, surface geometry, 
and surface orientation. 

In Fig. 8, a similar system to that of Fig. 6 is shown wherein the light sources are 
10 diffused light sources in the form of LEDs 21. Alternatively, the light sources 21 can be 
regular diffused light sources (bulbs) or other diffused lighting means. The elimination of 
a laser light source reduces the overall cost of the system. When using limited frequency 
LEDs, a frequency dependent optical filter may be employed to filter out ambient light 
from light reaching the detector. 

15 Transparent surfaces tend to be reflective in part. In Fig. 9, a transparent surface 

50 in the form of a glass plate is shown. Using the present invention, both a surface 
geometry and a thickness can be determined for the glass plate. As is noted in dotted line 
at 4d, a further image is detected having a different distance (in this case D ( plus twice the 
thickness of the glass plate). A processing means 60 resolves the images 7 and 7d and 

20 calculates image distances in order to determine plate thickness and surface geometry. 

Referring to Fig. 1 0, an embodiment of the present invention shown opposite a 
reflective surface with regular curved geometry is shown. A laser light source 2 is 
diffused by diffusion means 30 producing a recognizable pattern of light and dark. The 
diffusion means 30 acts as a plurality of objects. Detectors 9a and 9b in the form of CCDs 
25 are positioned proximate the objects 30. Alternatively, the detectors 9a and 9b are 

positioned in a location having a known spatial relation to a location of the objects 30. 
The detectors 9a and 9b are provided with a frequency selective filter means 56 for 
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filtering frequencies other than the laser frequency. Alternatively, the filter means filters 
ambient light of predetermined frequencies. Further alternatively, no filter is used. 

Returning to Fig. 9, In operation, light emitted by the laser 2 is diffused by the 
diffusion means 30. The diffused light is reflected from the reflective surface 5 and 
5 reaches the detectors 9a and 9b. It will be clear to those skilled in the art that diffused 
light will reach the detectors 9a and 9b whereas collimated light would be less likely to 
reach the detectors 9a and 9b in sufficient quantities. A range detection algorithm 
executed within a processing means 60, determines a distance between the detectors 9a 
and 9b and an image 7 of the objects (diffusion means) 30. Where, as in this instance, the 
1 0 reflective surface is non-linear, the image 7 is distorted relative to the objects 30 and/or 
magnified relative to the curvature of the surface. The processing means 60 correlates 
objects 30 and images 7. Alternatively, points on an object (known) are correlated with 
points on a captured image (reflected). Using the known spatial relation between the 
detectors 9a and 9b and the objects 30, the processing means determines a distance to at 
15 least some of the points on the reflective surface 5. Locations of these points are then used 
to determine a surface geometry for the reflective surface 5 and therefore orientation and 
magnification of the curved surface can be determined. At least 3 captured images are 
required to determine surface geometry. Preferably, more images are captured. Further 
images at different angles or from different known locations allow for the construction of 
20 a geometric model of the reflective surface 5. Alternatively, a large object with a 

discernible pattern is used to model the entire surface. Further alternatively, the diffused 
light source is stationary and only the detectors 9a and 9b move. In this last embodiment, 
the diffused light source's pattern is used to determine detector angle or location; image 
overlap is used to construct a model of the reflective surface 5. 

25 Referring to Fig. 1 1 , calculations used in determining a distance to a detected 

image are shown. A detector is spaced a distance Kl from a first object and a distance K2 
from a second object. The objects are spaced apart by a distance of K and the two objects 
and the detector are co-linear. Therefore, K- | K2 - Kl |. The detector detects images of 
each of the first and second objects. The images are at angles of a and 6, respectively, 
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Between the images of the first and second objects is a distance K similar to that distance 
between the objects themselves. Therefore, a triangle is formed with a known base and a 
known angle opposite the base. This results in a determined triangle. Once determined the 
values of Dl and D2 are calculated using trigonometric functions or other known 
5 methods. 

A second series of triangles is now formed in which the bases are K 1 and K2 
respectively. Angles of a corner of each triangle adjacent the base are known. The 
distance around the perimeters of the two triangles are Dl + Kl and D2 + K2, 
respectively. This is known because the optical paths from the detector to the images D 1 

10 and D2 are equal in length to the optical path from each of the first object and the second 
object, respectively. As the light travels in a substantially straight line from the object to 
the reflective surface and from the reflective surface to the detector, the distance D 1 is 
equivalent to the distance in traversing two sides of a triangle; the third side of the triangle 
has a length Kl. Similarly, D2 is equivalent to the distance in traversing two sides of a 

1 5 triangle; the third side of the triangle has a length K2. With this information the two 

triangles can be evaluated to determine all distances and thereby measure a distance to a 
point on a substantially flat reflective surface. This method of determining range is known 
in the art as photogrammetry. 

Referring to Fig. 12 an embodiment of the invention using a Bins detector 9 
20 having two apertures 9 1 and 92, a lens 96, and a CCD 97 and 4 diffusing light sources 3 is 
shown. Existing implementations of Bins systems weight standard plane of light range 
measurement contributions with Biris contributions to increase accuracy of a range 
measurement. A plane of light measurement forms a large part of a range measurement 
since it relies on a large triangulation base. 

25 When surface curvature is small, because of a small separation between apertures 

91 and 92 in the detector 9 mask a range is calculated by the system. The distance 
between the apertures 91 and 92 is referred to as b. Further, an angle of incidence of light 
is determined in dependence upon a point on a CCD within the detector 9 where the light 
is incident. The point is referred to as p. From these two values (p and b) range can be 

11 

SUBSTITUTE SHEET (RULE 26) 

) 9821550A1_I_> 


WO 98/21550 


PCT/CA97/00846 


determined (as explained with reference to Fig. 1 1 and U.S. Patent 5,270, Validation of 
Optical Ranging of a Target Surface in a Cluttered Environment to F. Blais). 

When curvature of a surface is monotonic, range measurements from 2 different 
profiles are used to evaluate the curvature of the surface. Alternatively, p is used as with 
5 other curved surfaces. Once a curvature of a surface is known, a relation between b and p 
becomes known and is used to validate range measurements. 

One possible algorithm that includes signal validation and range refinement based 
on low curvature property of a reflective surface is as follows: 

1 . for each detected image, compute a range; 
10 2. to each image associate an object; 

3. for each image range and associated object, compute a surface range and 
orientation; 

4. evaluate the surface orientation/curvature and range resulting from each 
computation in step 3 and correlate them; 

15 5. when the computed values do not correlate, associate the images with different 

objects and return to step 3 ; and 
6. when the computed values correlate, minimize any range surface curvature 

errors computed in step 3. 

In measuring range for curved surfaces compensation for curvature of the surface 
20 is applied. The compensation is used because curvature of a reflective surface alters image 
locations. When curvature is sufficiently small, the surface is treated as a planar surface 
for each measurement and a curved surface is reconstructed in dependence upon a 
plurality of range measurements. Alternatively, when the curvature of the surface is not 
sufficiently small, compensation is required. 

25 For a lens of radius r and index of refraction n, the focal length is 

r=(n-l)f (for a mirror n= -1). 
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The distance of the position of the image to the surface is modified by the 
curvature of the surface; however, the technique to compute the location of the reflective 
surface assumes a substantially flat surface (r=oo) and therefore, any change in image 
location results in a corresponding change to a measurement of range. In order to 
determine curvature for the surface using the above equations, we require its range. In 
order to determine the surface range using the above equations, we require a known 
surface curvature. Because both curvature and range are unknown, an iterative approach 
to converge measured range and curvature to corresponding values. A detailed 
mathematical explanation of a method employed is presented in Appendix A attached. 

Using a system as defined in the present invention, effects of laser speckle are 
reduced. Smooth reflective surfaces are known to reduce laser speckle. Further, 
polychromatic light sources may be used, thereby avoiding laser speckle. 

Anamorphic lenses may increase camera accuracy while retaining field of view. It 
will be apparent to those of skill in the art that as laser field of view increases, further 
constraints are imposed upon dimensions of light sources arrays. 

For imaging reflective surfaces with a high degree of curvature, light source and 
detector location is important. As such, specific light source-detector geometries for high 
curvature surfaces are employed. This improves a chance that sufficient images will fall 
within a field of view of a detector, and that those images are correctly associated with 
objects. Distinguishing between objects can be achieved in many ways. For example, 
each object (diffused light source) can have a different wavelength or a different shape. 
Allowing sufficient images to fall within a field of view is a geometrical problem to be 
solved in dependence upon known criteria regarding a surface. 

Referring to Fig. 13, a method of determining distance and reflective surface 
geometry is shown in a flow diagram. Diffused light is projected at a reflective surface a 
range for which is to be determined. The diffused light is in the form of at least an object. 
The diffused light reflects off the reflective surface and is detected by at least a detector. 
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At least two and preferably at least three instances of reflected light are detected by the ar 
least a detector. 

For each instance a range is calculated to an image (as viewed by the at least a 
detector) of the at least an object. Each image is associated with an object in the form of a 

5 diffused light source. The association is estimated and may be incorrect. In dependence 
upon each association, a range and orientation are calculated for the reflective surface. 
The calculated ranges and orientations for each image are compared to determine a 
surface. When a surface results, it is refined by reducing errors in surface range and 
curvature. When an inadequate surface results, at least an image is associated with a 

1 0 different object and the range and orientation is recalculated. The method continues from 
the calculation of range and orientation as set out above. 

A diffused light source is a primary light source providing diffused light. 
Alternatively, a diffused light source is a secondary light source transmitting or reflecting 
light incident thereon in a diffused fashion. A discernible object reflecting some diffused 
1 5 light acts a diffused light source. Further, as described above, the primary source of light 
need not provide diffused light and, in an embodiment, is a collimated laser light source 
in conjunction with a diffuser acting as a secondary light source. 

Numerous other embodiments of the invention may be envisioned without 
departing from the scope of the invention. 
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Appendix A 
Range measurement of reflectives surfaces 

- Compensation of surface radius: 2D case - 
This document evaluates the modifications that are needed to the range data to compensate for 
the radius of the object surface. 

The curvature of the object changes the position of the image of the source. If the curvature is 
small, then the surface can be considered planar and a direct reflection of the image occurs. If not 
then the location of the image changes and must be compensated. 

This document is confidential and is the property of: 
Francois Blais 

National Research Council of Canada, Institute for Information Technology 
Ottawa, Ontario, K1A-0R6 

Pate Bv Comment 

8/20/1996 F.B. Initial draft (rev II) 

8/21/1996 F.B. Initial draft (rev III) 

9/6/1996 F.B. Use tangential aberations 


For a lens or radius r and index of refraction n, the focal length is 

r«(n- 1) for a mirror (n=-1): f"— • 

2 

The distance of the position of the image of the source to the surface is modified by the "focal" of 
the surface, using the formula: 

-■— ! — _?■_!_ . — ! — r_obj is the position of the object 

f r_ls r_obj r r_ls r_obj 

However the technique to compute the location of the surface of the reflective object assumes 
r=oo and therefore the change in the location of the image will affect the exact location of the 
surface. 

We need the exact location of the surface to compute its curvature, and vice-versa. The idea is to 
iteratively converge to the exact surface location, each time computing a new surface curvature 
and position. 

From the range sensor the distance of the image to the camera he is related to the distance of the 
camera to the surface using: 

rio>roc r- ro ci = camera image, co=camera object, oi=object image 

The actual method, assuming a flat surface (r=-») computes the location roc. Assuming r<>a> 
(mirror) then 
ric imroc ^ roi 
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The sensor measures the modified position of the image ricjr. The compensated position ric is 
obtained using: 

i._L T ! X - — r_ls»r_obj_ 

oo -rjs r_obj_ r> r_°kj_ 

therefore, 

I I _l_ 

feq r_obj_m r_obj 

Knowing the normal to the surface: 5, and the angle of the camera, with the position of the image 
if a mirror was used: yi_m, zi_m 
1 (ys - yi_"i) 

oaatani 


I (zs - zi_m) 


/zi\ , /zi_m\ 

*- aten y * -atan iy7^ 


1 

R 


The equivalent focal length of the mirror is (using curvature c) 

R 1 - 1 

feq-f_nominafcos(* -S) f_nomins*y fjiominafc— feq-— cos(* - 6) 

Furthermore we have 

. zi- zo . . zi_m- zo 
r obj« r_obj_m» 

COS(<j>) " COS(((l) 

therefore, using z measurements as reference: 

111 ( 2-czo-zi. 2czo 2 cos(<j>)-cos((|> 5)zi ) 

» zi_iif — - 7 — ~ 

I /zi m zo zi zo (-2-c-zj • 2-c-zo - cos($)-cos($ - 8)) 

■cos(<|> 6) ! — 

2 c \ cos(()>) / cos(i)>) 


c-0 zitntz 

/ 1 2 .\ 

v-2-c-zo-zii- 2 c zo" - cos(<(>) -zy 

5*0 zi_m 


Given 

zi_m2»-cos($) 2 


1^-2-c-zi r 2 c zo - cos(<(>) 2 ) 

zi_n*zi_m2+ z zi«zi2rz 

zi2 1 , 2 c 1- — 

(-2-c-zi2-cos«>) 2 ) zi - m2 cos(*) 2 zi 


l 


I 


I 


I 'zi_m zo zi zo 

-cos(4> 6 ) 

2 c \ cos(4>) , cos(<)>) 


i i \ 

\ 2 c zo zi <- 2 c zo i cos (( )>)■ cos(i|) o)-zu 

( 2-c zi' 2 c zo ■ cos(<t»)cos(<t> - 6)) 
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2nd derivative of a surface vs curvature 

I'm trying to evaluate the relationship between the 2nd derivative and the curvature of a surface. 

This document is confidential and is the property of: 
Francois Blais 

National Research Council of Canada, Institute for Information Technology 
Ottawa, Ontario, K1A-0R6 


Date 


9/16/1996 


By Comment 


F.B. Initial draft 


The generalized spherical surface is 


1 - Jl - (I *-k)-cV 


Example: 


.• 2 2! 


z-- -c-r 
2 


sphere (k=0) 


parabola (k=-1) 


c = curvature of the surface 
r = radial coordinate 
k = conic constant 

k < -1 : hyperbolas, k = -1 : 
parabolas 

-1 < k < 0 : ellipses, k = 0 : 

sphere 

k > 0 : oblate ellipsoids. 


c-2- 


/ 2 2\ 


R 1 1 
Note: ft*-- f= — z» — r 
2 2-c 4-f 


Taking the derivatives: 

. (. f~. 2~Z 2 2 . 2 2 2 2 .) 

dz ,2- N l- I c -r <- c -r -k - 2i t- i -c -r ■>- i -c -t -k/ 


— -c-r- .- 
dr 


I ( i • ^ 2 2 2 2.] 
I \\ r i 1 - c r <- c r k/ 


■ 2 2 2 2. 
1 -r c r r c -r -k I 


d2z 4i - 3i-c 2 r 2 - 3i-c*r"-k - N i- 1 r c'-r' v c'-rkc'-r'-k - - I r c' r* t- c"-r"-k >- 1 t- c' r" - c^ r'-k-c'-r' 


2 2 2 2.22 


2 2 2 2. 


2 2 2 2, 2 2! 


dr" 


.. d2z 
lim — »c 

r - 0 dr 2 


■ . ■. 22 22... 22 22.. 

\l t i - r I rc -r » c -r -k) -\- 1 r c -r i- c -r -k/ 
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For the sphere: k=0 


r. 


Substituting c»-jc2 y«l - c r 

( f~i 2~2 2 2. [~. 2~2 .. ,. 2 2) 

\ A :- 1 t c r c -r - 4-^- 1 tc-r t 4i - 3ic -r / 


c2t 


(y- I) 


d2z 
dr 2 ' 


dz 


( 2 -j-WcV-2i,i.cV) 


ds 1 1 , ■ ri 2 2 i n 2~i 

d2z JTor 


dr 2 f ! » ! 


Substituting dr from the first derivative 
l dz 2 


dz - y 


d2za- 


From the first derivative: 


dz ^i - y 
dr" r 

vy 


dr 4 


d2z- 


1 dz 


W J. ■«».■» 


(dr J ,<lz J ) 


d2z"c 


(dr 2 , dz 2 ) 


1 - c r 

(!) 


2 2 dr 


(dr 2 .dz 2 ) 


dr 


d2z 


i 2 v ' 
\dr > dz"./ 


Rewritten in a more "usefull" format 
d2z 


■ d2z 


dr" 


— »dz 
dr 


i.e. 


d2z«d2z rdr 


d2z r 


(l^dz.r 2 ) 


if, dr 2 1 

— i l - -. r- 1 

2 1 1,2 . 2\ 

c [ vdr i-dz,J 


dz»dz rd 
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Claims 

What is claimed is: 

1. A method of measuring a distance from a first location to a reflective surface 
comprising the steps of: 

5 directing diffused light toward the reflective surface to form a first image therein; 

using a range imaging means having a detector to measure a distance from the detector to 
the first image formed by the diffused light; and 

determining the distance to the reflective surface based on a known relationship between 
the location of a diffused light source, the location of the detector and the distance from 
1 0 the detector to the first image formed in the reflective surface. 

2. A method of measuring a distance to a reflective surface as defined in claim 1 wherein 
the distance from the detector to the first image is determined in dependence upon 
detecting the first image with a plurality of detectors. 

3. A method of measuring a distance to a reflective surface as defined in claim 2 wherein 
1 5 the plurality of detectors is at least 3 detectors and, wherein the method further comprises 

the step of determining a surface geometry of the reflective surface. 

4. A method of measuring a distance to a reflective surface as defined in claim 1 wherein 
the first image and at least another image are formed in the reflective surface, and, 
wherein the method further comprises the step of: 

20 detecting the at least another image with the detector; 

and wherein the distance from the detector to the first image is determined in further 
dependence upon the detected at least another image. 
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5 A method of measuring a distance to a reflective surface as defined in clairnM wheren. 
the plurality of images is at least 3 images and wherein the method further comprises the 
step of determining a surface geometry of the reflective surface. 

6. A method of measuring a distance to a reflective surface as defined in claim 1 wherein 
5 the first image and at least another image are formed in the reflective surface, and, 
wherein the method further comprises the step of: 

using a plurality of detectors having a known spatial relation therebetween to detect the at 
least another image; 

and wherein the distance from the detector to the first image is determined in further 
10 dependence upon the detected at least another image and the known spatial relation. 

7. A method of measuring a distance to a reflective surface as defined in claim 6 further 
comprising the step of determining a surface geometry of the reflective surface. 

8. A method of measuring a distance to a reflective surface as defined in claim 1 wherein 
the detector is a Biris detector. 

9. A method of measuring a distance to a reflective surface as defined in claim 1 wherein 
the diffused light forms a plurality of objects, the directed light reflected off of the 
reflective surface forms a plurality of images, and the range is determined by the steps of: 

a) associating each image from the plurality of images with an object from the plurality of 
objects; 

20 b) using the processing means, for each image, determining a distance to an estimated 
reflective surface in dependence upon the associated object location, the location of the 
detector, and said image location; 

c) comparing the estimated surface determined for each image with estimated surfaces 
determined for other images and evaluating the surfaces to see if a substantially same 
25 surface is determined; 
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d) when substantially a same surface is not determined, using a processor, associating 
each image with a different object from the plurality of objects and returning to step (b); 
and, 

e) when substantially a same surface is determined, using the processor means, correcting 
5 the surface in dependence upon each determined surface. 

1 0. A method of measuring a distance to a reflective surface comprising the steps 
of:projecting toward the reflective surface, a pattern of diffused light forming an 
object;using an imaging means comprising a detector, said detector having a known 
spatial relation to the object, receiving some of the projected light reflected off of the 

10 reflective surface and forming an image of the object;using a processing means, 
determining a range to an image of the object; andusing the processing means, 
determining a distance to the reflective surface based on the known spatial relation and 
the image range. 

1 1 . A method of measuring a distance to a reflective surface as defined in claim 1 0 further 
15 comprising the step of: determining, in dependence upon the range determined for the 

image and the known spatial relation, a surface geometry and range for the reflective 
surface. 

12. A method of measuring a distance to a reflective surface as defined in claim 10 
wherein the pattern of diffused light forms a plurality of objects, the projected light 

20 reflected off of the reflective surface forms a plurality of images, and the range is 
determined by the steps of: 

a) associating each image from the plurality of images with an object from the plurality of 
objects; 

b) using the processing means, for each image, determining a distance to an estimated 

25 reflective surface in dependence upon the known spatial relation and said image location; 
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c) comparing the estimated surfaces determined for each image and evaluating me 
surfaces to see if a same surface is determined; 

d) when substantially a same surface is not determined, using a processor, associating 
each image with a different object from the plurality of objects and returning to step (b); 

5 and 

e) when substantially a same surface is determined, using the processor means, correcting 
the surface in dependence upon each determined surface. 

1 3. A method of measuring a distance to a reflective surface as defined in claim 10 
wherein the pattern of diffused light is formed by projecting collimated light toward the 

1 0 reflective surface and diffusing the collimated light prior to the light reaching the 
reflective surface. 

14. A method of measuring a distance to a reflective surface as defined in claim 10 
wherein the projected pattern of diffused light comprises lines of varying lengths. 

15. A method of measuring a distance to a reflective surface as defined in claim 10 further 
1 5 comprising the step of filtering ambient light from light reaching the detector. 

16. A method of measuring a distance to a reflective surface as defined in claim 10 
wherein the imaging means comprises a plurality of detectors. 

1 7. An imaging system comprising: 

a diffused light source for directing diffused light toward a surface and for forming at 
20 least an image therein; 

an imaging means comprising at least a detector for receiving diffused light reflected from 
the surface and having a predetermined spatial relation with the diffused light source; and 

image processing means for determining a distance from the system to an image of the at 
least an image and for determining a distance from the system to at least a location on the 
25 surface from which diffused light is reflected. 
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1 8. An imaging system as defined in claim 1 7 wherein the diffused light source is for 
directing diffused light of substantially a same wavelength. 

19. An imaging system as defined in claim 17 wherein the diffused light source is for 
forming a predetermined pattern of light and dark. 

5 20. An imaging system as defined in claim 1 7 further comprising means for determining a 
surface geometry of the surface in dependence upon the distance. 

2 1 . An imaging system as defined in claim 1 7 wherein the diffused light source comprises 
a collimated light source and a diffusion means. 

22. An imaging system as defined in claim 1 7 wherein the diffused light source comprises 
10 an LED. 

23. An imaging system as defined in claim 17 wherein the diffused light source comprises 
a laser diode. 

24. An imaging system as defined in claim 1 7 further comprising a filter for filtering 
ambient light from light reaching the detector. 
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